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ABSTRACT 



Talking video games can provide simulated voice dia- 
log between human players and animated characters on 
a TV screen. Two or more players can take turns re- 
sponding to animated characters and two or more ani- 
mated characters can respond to each player and to 
each other, thereby providing three-way or four-way 
conversations. Pictures and voices are generated from 
digital data separately stored on a laser-readable disk 
such as a CD-ROM in compressed form. As the game is 
played each animated character talks to the human 
game players and waits for a response. Each player has 
^ hand-held controller that displays two or more 
phrases or sentences and a player responds by pressing 
a button next to a selected phrase. An animated charac- 
ter then responds to the selected phrase as if it had been 
spoken by tiie human player. Speech recognition is not 
required. Each scene branches to two or more subse- 
quent scenes. But within each scene there are several 
branching dialog sequences, thereby providing a large 
variety of possible dialogs. Human game players are 
thus given an illusion of having dialogs with interesting 
people, either Hving, historical or imaginary and with 
animal-like characters on a TV screen as an active par- 
ticipant in adventures and dramas with these characters. 
Additionally, human game players can utilize the hand 
held controllers to select the voice dialog between 
game characters, thus controlling conversations held 
between game characters during the game. 

16 Claims, 8 Drawing Sheets 
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background. Pac-Man did quite well even though it had 
TALKING VIDEO GAMES only a simple background maze. Recent video games 

abo make use of a repetitive backgromid. The reason 
This application is a continuation of application Ser. these games have high play value is the large variety of 
No. 07/614,843, filed Nov. 14, 1990, now abandoned. 5 possible plays and sequences of plays in each situation. 

^ And so it should be with talkinfi video games. 

TECHNICAL FIELD OF THE INVENTION ^ ^^^^ i^video g^art for sto- 

This invention relates to video games, animated car- ries to branch. It ^ also common practice for digital 
toons, and picture/sound synchronization. data of animated characters to be stored separately from 

^,r*T^ ^.^w^ wi.T^T^i.i^r^i^T 10 background scenery and to generate each frame of an 

BACKGROUND OF THE INVENTION animated picture from both the background data and 

We are all bom with a desire to talk and to be talked the character data to minimize the number of stored 
to. Most of us find talking a pleasant experience and we images. 

do it more often for pleasure than for necessity. Listen- It is a weU known for human players to input choices 
ing to other people talk and thereby sharing their emo- 15 using any of a variety of input devices such as push 
tional ezpenences is also a desire we are bom with and buttons, rotatable knobs, pressure sensitive membrane, 
this deare has been exploited in motion picture film and proximity sensitive pads or screen overlay, light pen, 
television in which voice sounds are now essential. But light sensitive gun, joy stick, mouse, track ball, moving 
until recently, voice sounds were seldom used in video a cursor or crosshairs or scrolling through highlighted 
games or were used as an optional gimmick to add a 20 options, speech recognition, etc. 
little realism to the game, rather than to simulate dialog. In the prior art, each choice by the human can be 
The large amount of memory required for good quality immediately followed by a synthesized voice or digi- 
voice sounds has made voice impractical for home tized voice recording that sp^ks the words selected by 
video games, untU recently. But now lower memory the human player, so the human will quickly adjust to 
prices and digital disks such as the CD-ROM and com- 25 the fact that the spoken words he hears for his side of 
pression techniques have made talking video games the dialog are initiated by his fingers rather than his 
practical, vocal cords. 

But adding voice sounds to conventional video games The characters in video games and computer games, 
is not enough to simulate a face to face voice conversa- especially role-playing games, are of two types: player- 
tion. A talking video game called Thayer's Quest was 30 controlled characters (or player charactere) and non- 
attempted in 1984 and was played from an analog laser* player characters. A player-ccontrolled character is a 
readable video disc. One of the reasons for the commer- human player's animated counterpart and does what the 
cial failure of Thayer's Quest was that each spoken human player chooses to have him do. Non-player char- 
sentence was programmed to accompany only one se- acters do only their pre-programmed actions and speak 
quence of video frames. Since the video was not com- 35 their fixed speeches and are not directly controlled by a 
pressed, the Tu aTimiiTn amount of play time was limited human player. However, non-player characters can be 
to about half an hour which was further reduced to a indirecliy influenced by a human player, either by re- 
fraction of that by the branching story. Hence, only a spending to an action selected by the human or be re- 
few minutes of vMce sounds were actually heard during spending to what a player-controlled character does or 
the game. Whenever a human player saw a certain 40 says. 

video character, the character always spoke the same The prior art also includes methods for generating 
words. This greatly reduced the entertainment value of video images of moving hps and facial expressions on a 
the game. Another consequence of programming the talking head or other animated character. See for exam- 
audio and video to be inseparable, was that branching pie, U.S. Pat. No. 4,884,972 issued Dec. 5, 189 to Elon 
scenes were not distinguished from branching dialog. 45 Gasper who contemplates use in video games. 
Human players were able to navigate through a maze of The film and television industries already address the 
roads, but the game play did not feel like a conversa- human desire to watch and listen to important and inter- 
tional dialog. It was more like "Which road do you esting people. But there is also a basic human deshe that 
want to take next: (1) or (2) or (3)? Make your selec- people respond to us as individuals. No industry yet 
tion." Talking video games will be much more enter- 50 satisfies this desire that important people reply to us as 
taining if each scene has a rich variety of possible dialog individuals. Although the telephone provides a partial 
sequences. satisfaction of our desire to talk with other people, it is 

Talking video games are disclosed in my U.S. Pat necessarily limited to living people who are willing to 
Nos. 4,305,131; 4,333,152; 4.445,187 and 4,569.026. talk with us. Historical and imaginary people cannot 

Another problem in the prior art is how to prevent a 55 talk with us and famous living people don't want to. 
combinatorial explosion, Le. an exponential increase of Hence, there is is a strong but u n fulfilled human desire 
scenes if each branch branches, and each of those waiting to be satisfied by new technology, 
branch, etc. If branches did not merge or loop, the Often an illusion is as satisfying as a real experience, 
limited amount of bytes on the CD-ROM would be as any TV viewer knows. When you watch people on 
quickly exhausted after less than a dozen branches. 60 TV, what you are actually watching are little flickering 
Branches should usually merge with other branches or dots of colored Eght from a chemically coated sheet of 
loop back to prior scenes. But this does not mean that glass. The voice sounds you hear are from a vibrating 
repeated scenes should play exactly the same each time. cone of paper. That is reality. The rest of your experi- 
Each time a scene is repeated there should be different ence is illusion. But it is an illusion that everyone wants 
dialog and/or different characters. Successful games of 65 to experience and will gladly pay money for. The desire 
the past have made use of a rich variety of possible plays to talk with interestmg, charismatic and famous people 
against a simple repetitive background. Chess has been is also strong and millions of people will be satisfied 
popular for centuries with only a very basic checkered with an illusion of such conversations. 
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Talking video games (talkies) will change the nature (2) "I've got a chain in my car, We can pull the door 

of video games as dramatically as talking pictures off," Either way the character replys "Ok, but do it 

changed silent fihn. Talkies will let users chat with quick! "and a few seconds later yells *Taster ! Faster ! 

images of famous people (living or historical or imagi- Do something!" 

nary) and with animal-like characters, and participate in 5 Then, depending on your selection, the character is 
simulated adventures and dramas with interesting char- shown using a fire extinguisher or using a chain to pull 
acters who talk to each player rcsj>onsively. The con- the car door open. Or (see FIG. 7) hands reach up from 
versations will be one-sided; of course, with the on- the bottom of the TV screen to simulate the hands of a 
screen characters doing most of the talking. But talkies human player helping the animated character, 
that stir human emotions Hke dramatic films will have 10 The next tune you encounter this situation the char- 
lasting appeal, because they will satisfy a basic human acter has been modified to seem like a different person, 
desire, the deare to talk with other people. His/her personality is different. His/her voice and face 
--.T. rwrm TXTT7T5xrmi^xT different (chosen by the system from a catalog of 
SUMMARY OF THE INVENTION ^^j^^ burning car is a different color, 
This is a video game which takes the form of a 15 And the dialog has changed. The character cries 
branching story that simulates dialog between two or "Please help me. There's a little boy trapped in the car, 
more animated characters on a TV screen and two or I cant get the door open." You can choose eithen 
more human game players, thus simulating three-way (1) "Loop this chain through the door. Fll hook it to 
or four-way dialog. Each character can be an animated my car.** or 

cartoon, digitized live action, analog live action, a sprite 20 (2) "Use this pipe to pry the door open.** Either way 

or the like, and be player controlled or not. the character yells "Hold on We'll get you outi** 

^ , «„^r^^ Then, depending on your selection, the character is 

BRIEF DESCRIPTION OF THE DRAWINGS ^j^^^ ^^^^ ^j^^in to puU open the car door, 

FIG. 1 illustrates an animated cartoon talking game In ather case the fire flares up and the character yells: 

with two human players who take turns selecting words 25 "It's not working. Do something! Do somethingi "You 

to say to one or two animated characters on a TV can choose to say: 

screen who then respond to the words. Subtitles on the (1) "Keep trying It*s ahnost open.** or 

TV screen tell each player what is being said by the (2) "It's stuck. Full harder— Harder!" or 

other player. (3) "Too late. It's going to explode,*' 

FIG. 2 illustrates an animated talking game with one 30 Note that there are two kinds of branching in each of 

human player and two animated cartoon characters on the above sequences. The plea for help scene branches 

a TV screen who talk to the human and to each other. to the fire extinguisher scene or the pipe scene But there 

FIG. 3 is an animated cartoon illustrating a kissing is also branching in the dialog within each scene. Dialog 

scene in which one character's unspoken thoughts are branching docs not require different animation data 

sounded. 35 except in mouth and body movements, but it adds inti- 

FIG. 4 is an animated cartoon illustrating a ledge* mate involvement m the dialog that scene branching 
hanging scene in which a talking cartoon character cannot provide. If each scene has a rich dialog it re- 
requires immediate action by the human player. quires much less video data than if each dialog branch 

FIG. 5 is an animated sequence illustrating branching required different video data, 
dialog in which two cartoon characters respond to 40 Repeatedly showing the same background and char- 
sentences selected by a human player by talking to the acters with different dialog will expand the limited 
human player and to each other. capacity of a CD-ROM disk into a large number of 

FIG. 6 is an animated sequence illustrating branching different story lines. Having the same background ap- 
dialog in which one animated character responds to a pear again and again is acceptable if a variety of talking 
sentence selected by a human player and refers to a 45 characters do and say different things against that back- 
second character (not shown). ground. 

FIG. 7 is an animated sequence showing hands simu- For a human player to know how to respond, the 

lating the hands of a human player performing an ac- alternative choices can be communicated to him in 

tion. different ways: 

FIG. 8 is a flow diagram illustrating scene branching 50 1. by displaying a menu of words or phrases or icons, 

and dialog branching within each scene. either on the TV screen or on an auxOiary display, 

FIG. 9 is a pictorial view of a video game system giving alternative things to say to a non-player charac- 

having a CD-ROM disc drive connected to a TV set or ter or alternative things a player-controUed character 

video monitor with auxilary devices for displaying will say; 

prompting words. 55 3, by a talking character giving the alternatives ver- 

^ * » ,e T^T A T haHy, by asking a question or by suggesting alternatives; 

EXAMPLES OF GAME DIALOG 3 ^ ^^^^ character showing the alternatives by 
Each scene branches to two or more subsequent holding a chain in one hand and a prybar in the other, 
scenes, but there is also a second level of branching for example; 

dialog within each scene. Referring to FIG. 6 as an 60 4. by one talking character making a remark to a 

example: second talking character (either on-screen or off- 

The animated character looks at you anxiously from screen); 

the TV screen. In the background is a burning car. The A simulated voice dialog within each scene that does 

character yells to you "My mother's trapped in the car. not require speech recognition can be of several differ- 
I can't get her out. She's going to die." You the player 65 ent kinds: 

can choose either: 1. spoken voice from animated character, then push- 
(1) "I've got a fire extinguisher in my car. PU get it" button response from player, then voice from animated 

or character responding as if he had been spoken 
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2. spoken voice firom animated cliaracter, then push- the menu displayed to one player may be different from 
button response from player, then voice response from the other player's menu. Part of the fun comes from not 
game On a different voice) to simulate the player's side knowing what choices the other player has. Also, TV 
of the conversation, then voice from animated character screen menus disrupt the illuaon that a player is talking 
responding as if he had been spoken to; 5 with a real TV character. Hence, the preferred embodi- 

3. spoken voice from animated character, then push- ment of my invention makes use of hand-held menu 
button response from player," then voice from one ani- display units with one push-button for each menu item 
mated character, talking to a second animated character and echo voices to avoid sub-titles on the TV screen, 
to same scene nsponding to the push-button re- DETAILED DESCRIFnON OF THE 

SpOnSe; TkJxrcKrrtrw.i 

4. spoken voice from first animated character speak- INVENTION 

ing to a second animated character, then push-button Referring to FIO. 1, m one embodiment of this inven- 

response from player, then voice from the second char- tion a video game system displays on a TV screen 11 an 

acter speaking the words selected by the player or re- animated picture sequence to two human game players, 

spending to them; 15 Human players 10 and 12 take turns selecting a phrase 

6. spoken voice from animated character, then push- or sentence to "say" to a character or characters on a 
button refuse from a first player, then echo voice TV screen who dien talk back responsively. In this 
from the game system On a voice different from charac- example it is player lO's turn. Player 12's hand-held 
ter) so that a second player can hear what the first controller is blank, indicating that she cannot say any- 
player has "said", then voice from the animated charac- 20 thing at this moment The TV screen shows two ani- 
ter responding to the first player's input, then push-but- mated characters traveling in a boat or other vehicle, 
ton response from a second player, then edio voice The characters are talking non-player characters, Le, 
response from game to simulate second player's side of players can "talk" to the characters who will then talk 
the conversation so that the first player can hear what back, but players cannot put words in their mouth, in 
the second player has "said"; 25 this example. Each human player holds a hand-held 

7. spoken voice from animated character, then push- controller with three push buttons next to a liquid-crys- 
button response from a first player, then sub-titles on tal display 13, shown enlarged in FIG. 1 for clarity. 
TV screen so that a second player can see what the first As the boat scene begins, the video game system 
player has "said", then voice ff-om an animated charac- displays two or three or more alternative responses on 
ter responding to the first player's sub-titles, then push- 30 display 13 or TV screen or other display device. While 
button response from the second player, then sub-titles player 10 is deciding which button to press, a linking 
to simulate second player's side of the conversation so picture sequence (not shown) continues to show the 
that the first player can see what the second player has same boat scene with one character looking back from 
"said". the boat as if looking at player 10 standing on the dock. 

A similar dialog would follow in the same scene or in 35 Player 10 selects one of the displayed responses (in this 
the next scene with different words. By definition, each example "WHERE ARE YOU GOING?*') which is 
scene change involves a substantial change in back- then echoed as voice sounds or is displayed as sub-titles 
ground or a change to another full-screen character and on the TV screen so that player 12 will know what 
hence requires substantially different video (not just lip player 10 has just said to an animated character. This 
movements or showing the same background at differ- 40 character 18 answers responsively with voice sounds: 
ent views or angles). Each scene should have several *TO THE ISLAND." after whici a second character 
exchanges of dialog which requkc only minimal video responds with 'WE'LL BE THERE AN HOUR." in 
changes such as head and Hp movements. The video response to what character 18 just said. Using incom- 
(both background and characters) may be rapidly plete sentences in each animated character's voice leads 
changing and these changes may be the same every time 45 human players to pay attention to the echo voice or 
a scene is repeated. But the voice soimds should be sub-titles. In the preferred embodiment the game system 
different and characters should say different things each generates a voice to echo the words selected by player 
time a scene is repeated. 10 so that player 12 hears what player 10 has "said" to 

Player-controlled characters say whatever the human the animated character. When it is player 12's turn, 
player chooses to have them say, but non-player charac- 50 player 12's hand-held di^lay will then show alternative 
ters should also be programmed to say many different words (not shown in FIG. 1) that she can "say" in re- 
alternative things depending on what a player or player- spouse to what animated character 17 or 18 has said, 
controlled character has just "said". A scene may loop Thus a three-way or four-way dialog can be simulated, 
a dozen times with a non-player character saying some- When alternative words or other verbal expressions 
thing different each time and the alternative responses 55 are shown on LCD display 13, the words may be 
for each human player bdng different each time around blinked a few times or display 13 may be flashed by 
the loop. alternating black and white a few times to attract a 

Menus showing two or three or four phrases to say player's attention and prompt him to make a choice. Or 
are better than the old keyword-keyword method used a small Hght-emitting diode may be blinked on and off a 
in many role-playing games because menus do not force 60 few times as a prompting signal, 
each player to guess about what can said. Guessing is Before each game begins, display 13 may show identi- 
fine for puzzle games, but is quite disrupting in role- tying information for each player-controUed character 
playing games. Trial and error slows down the pace of so that each human player may select which character 
the game^ especially for other players, and weakens or he or she wants to play. Alternatively, each player-con- 
destroys the suspense and emotional involvement that 65 trolled character may be shown on TV screen 11 and 
captivates a game player. the question asked "Who wants to play this character?" 

Hand-held display units are preferable to displaying for each character shown. The game system then re- 
menus on the TV screen, because in two-person games cords which hand-held controller responds so that later 
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that character's words to say will be shown on display Referring to FIG. 5, picture sequences 21, 25, and 28 
13 only for the player who is playing that character (in are parts of one roof scene in which two talking charac- 
this example player 10). A human player may also ters discuss h ow to rescue-t hexh aracter in FIG. 4. One 
choose to play a player-controlled character that need or t>vohu mn players participate in the conversation by 
not always be on the TV screen, but who may be off- 5 '"saymg" words or pnrases or sentences to the animated 
screen < standing on the dock in FIG. 1), and can carry characters who then answer responsively and ask ques- 
on a dialog with on-screen characters. Each echo voice tions or make remarks that lead to the next input by a 
is the voice of a player-controlled character. player. The alternatives shown on display 22 are sug- 

Referring to FIG. 2, in another embodiment of the gested solutions to the problem posed in sentence 20. 
invention, a video game system generates for display on 10 When the human player 10 presses button 14 next to 
a TV screen 11 an animated picture sequence having "Call emergency", one of the characters responds by 
two or more animated talking characters 17 and 18. In asking question 23 to the other character who responds 
this example, character 17 is a player*controlled charac- with question 24 directed at the human player. Question 
ter that human player 12 control. Player 12 plays the 24 is also accompanied by alternative actions 26. V^h^ 
role of character 17 and can talk to character 18 and 15 a player presses the button next to "Slide down the 
other characters in the game through character 17. rope" , a character comments on this choice of action 
Player 12 holds a hand-held controller with three push with sentence 27 in sequence 28. Thus a simulated ver- 
buttons next to a liqmd-crystal display 13, shown en- bal dialog can continue through several exchanges of 
larged in FIG. 2 for clarity. The game system displays words within the same scene. 

three alternative responses on display 13. Player 12 20 Referring to FIG. 6, in another embodiment of this 
selects one of the displayed responses (in this example invention a video game system generates for display on 
"KISS ME AGAIN") with push button 14. Echo voice a TV screen an animated picture sequence 31 and 32. 
sounds 15 for character 17 tfien say the words selected The picture sequence has one scene showmg a burning 
from display 13. The words are directed at character 18 car in the background and a frig htened woman 17 in th e 
whose voice sounds 16 then respond to character 17, 25 foreground. During part 31 of tfie sequence the wom- 

The two animated characters 17 and 18 may respond an's voice 15 says "Please help me! My mother's 
in reverse sequence, that is, the non-player character 18 trapped in the car!" The game then displays two or 
may say his line first so that the player-controlled char- more alternative responses on hand-held display 13 or 
acter 17 can respond as ordered by human player 12. on the TV screen or other display device. The human 
For example, after player 12 selects "KISS ME 30 player 10 selects one of the displayed responses (su ch as 
AGAIN"', character 18 may say "WHAT DO YOU * Trv the doo r opem'M and presses t he corresponding 
WANT TO DO?** a prerequisite sentence that is not piish button 14 or equivalent While Ae ^yer is dec id- 
one of the displayed alternatives, then character 17 can ing which button to press, a linking p icture sgguPTice 
respond with "KISS ME AGAIN" which is responsive (not shown) continues to show the same scene with the 
to what character 18 has just said. Such reversals can 35 woman looking anxiously at the player. When the 
make the dialog seem more spontaneous. player selects a response, part 32 of the animated se- 

Echo voices or sub-titles may also be used to express quence continues showing the same burning car scene 
unspoken thoughts or the thoughts of non-speaking with the woman's voice 16 answering responsively, for 
beings such as babies or animals, or inanimate objects example: "I tried to. hulLl can*t get it open" as at 16. 
such as a thinking rock. Cloud baUoon 19 represents an 40 Selecting a response by pushing a button 14 can result 
unspoken thought of character 18 in FIG, 2 which is in a change to a different scene, but in this FIG. 6 exam- 
sounded (with mouth not moving) in response to spoken pie the scene remains the same and only the dialog 
sentence 15 of character 17, Voice sounds for unspoken changes. Each of the three alternative responses on 
thoughts may be electronically altered to indicate to display 13 will result in a different answer by animated 
players that a voice is not a normal spoken voice. For 45 character 17. The animated sequences 31 and 32 are 
example, unspoken thoughts can be given a hollow or generated by the video game system by overlaying 
tremulous sound or a whispering sound by electroni- three moving pictures: (1) the background sequence 
cally or digitally editing voice sound data before con- showing the burning car with flames continually fUck- 
verting to audio. ering, (2) a sprite or mosaic of sprites showing the 

Referring to FIG. 3, when characters 17 and 18 per- 50 woman character 17 moving in a natural manner against 
form a competitive or cooperative activity such a^^kKs^ the background (This motion can be the same regardless 
ing, one of the characters may speak (with moving of the dialog) and (3) mouth and other facial sprites 
mouth) or think uiispoken thoughts (sounded with un- selected (by table lookup) by the game system to be 
moving or unsynchronized mouth) as in cloud balloon approximately lip-synchronized with voice sounds 15 
29, responsive to the action being shown or to what was 55 and 16. 

said or done in the prior sequence shown in FIG. 2 or in Since the player's response time is variable, sequence 
response to a phrase selected from display 13. 31 or 32 with a closed mouth sprite should cycle contin- 

Referring to FIG. 4, in another embodiment of this ually until a button 14 response is made or until a time 
invention a video game system generates for display on limit is reached, at which thne a prompting picture 
a TV screen an animated picture sequence showing a 60 sequence with words such as "Hurry! Hurry!** may be 
character hanging by his fmgers from a ledge on the sounded and displayed with moving mouth sprites. The 
outside^ ^a buildmg. His Inends 6ti therroot have burning car can be any object such as a damaged bus, 
thrown^Ei m a rope which is not long enough to reacTi airplane, boat, or building that provides a danger situa- 
the FIG. 4 character. This ledge-ha nging situation sets tion. 

up the next scene shown in FIG. 5 in which two ani- 65 Referring to FIG. 7, the game system generates for 
mated characters exchange dialog with one or two display on the TV screen an animated sequence show- 
human players and with each other regarding the FIG. ^"J^ ftn^ ^^^^ h^itf^^ ^ simula^'^fT ^^'^ ^^"^^^ ^ — 
4 character. hmnan player performing an action. In thk pyampl^p 
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animated sequence 33 shows a hand holdinm ipe 35 or distinctive voice can be lip-synchronized with different 
a fire ext inHuisher or other such tool whil^_5 ^e human mouth movements depending on which branch the 
pl ayer whose real hand 10 i s illustrated preSinRj^utton dialog takes. The digit^ data for each animated charao- 
14 next tojjIispla Y 13 selects one of the ahemative ac- ter may also combine body, Hps, expressions, gestures 
tions shown on display 13. Note that display 13 in FIG. 5 and voice sounds. 

7 shows alternative actions which would result in scene When a human player presses a button 14 (FIG. 2, 5, 
changes, but display 13 in FIG. 6 shows alternative 6, or 7), the game system may generate a voice sound 
words or phrases to say to animated character 17 in a speaking the selected sentence as a substitute for the 
common scene. In FIG. 7, pressing button 14 to select player's side of the dialog. The animated character then 
"Pry the door open" results in picture sequence 34 10 "responds" as if the generated voice sounds had been 
showing hands 36 prying open the car door with pipe spoken by the human player. Because the player selects 
35, the words Which are actually sounded, he wfll quickly 

The flowchart shown in FIG. 8 illustrates the distinc- adjust to the feet that the spoken words he hears for his 
tion between branching dialog and branching scenes. of the dialog are initiated by his fingers rather than 

For exan^lc, in scene 64 branch point 60 is displayed to 15 jjjg vocal cords. This echo voice is important for games 
the player showing two alternative verbal responses 61 multiple human players so that each player will 

or 62. Either verbal response results in a different an- ^|^^ other players has "said" to on- 

swcr from an animated character, but -not a scene screen characters. Pushmg a button 14 selects both a 
change. However, the alternatives at branch point 63 sunulated verbal response to the previous words spoken 
will result in a scene change, either to scene 65 or to 20 ^ animated character and also selects a new dialog 
scene 66. Branch point 62 may result in either a scene sequence that corresponds to the simulated verbal re- 
change to scene 67 or a dialog branch depending on a ^^^^^^ shoym on display 13. The selected (fialog se- 
player's choice. quence includes the face and voice of the animated 

Rcferrmg to HG. 9, video game system 42 is con- ^.^aracter speaking words which arc responsive to the 
nected by cables to a TV set 11 or video monitor and to 25 ^^^^^^ ^^^^ ^ 

one or more hand-held control umte 44 and 47 or porte^ Alternatively, sub-titles such as illustrated on TV 
ble game systm 46, each Imymg ttiree push buttons 14 ^^^^^ ^ ^^j^^ ^^.^ 

next to a hqmdKTj^tal display 13. Infra-red or radio ^ ^ ^ ^ hand-held 

signals may be «f<^^/«Jtead °f .^^^^^^ f f^J?" display unit as a substitute for the player's side of the 

S^l^x?.^.?^'^'^''^^''^*^ *^^^^ di^V Digitized Uve action pictL sequences are 

ROM disk 43, or wnteK)nce disk or ^ or o^er me^ ^ « cartoon picture ^uences for 

dium contammg digital data ^^^^^^^^^^^^^^^ tSs invention. The term "verbal expression^ means any 
generates ammatcd P^^^^,^^^.^^^^ word, words, phrase, sentence, question, expletiv^^ 

audio for voice and other sounds, synchromzmg data, j u^^^^a ^««w«ofir,« *^rr^^rr^^- Z 

and words to display on units 44, 46 and 47. Portable 35 f^^^ keyword, combination huh? or Wn or 
^e system 46^ appropriate ROM program car- »aught^ or scream. The word kissmg is used herein to 
SSie ^substitute forLite 44 and 47. Cable 45 con- mean simulated touchmg of one ammated character's 
necte game system 42 to display unit 44, 46 or 47 and mouth to another ammated character s mouth or other 
transmits alternative prompting words or other verbal ^ . ^ j *u j c a u 

expressions for display on dispkys 13. Cable 45 also 40 Although I have descnbed the preferred embodi- 
tr^mits push-button 14 responses to system 42. mente of my mventon with a degree of particulanty it 

If portable game system 46 has only one or two avaD- ^ understood that the present disclosure has been made 
able push-buitons, selection from among responses by way of example and that eqmva^ent steps and 

shownondisplayl3niaybedoneasshowninFIG.7by components may be substituted and desi^ details 
pressing push-button 14 multiple times to position a 45 changed without departmg from the spint and scope of 
pointer 49, cursor, or other such indicator next to (or my invention. 

on) a selected sentence. \ , - , ^ . „ . , 

To aUow each background scene to be used with 1- A method of electromcally simulatmg voice con- 
different animated characters who can move around versations between at least two talldng animated char- 
against the background scene, the digital animation data 50 acters, the words of one cWacter bemg selected by a 
for the background scene should be stored separately h«man player, compnsmg the steps of: 
from the digital anunation data for each character. Simi- (a) digitaUy storing a catalog of distinctive voices for 
larly to allow each character to say many different at least two talking characters, each m the form of 

sent^ without a scene change, the digitized voice voice sound data representing a pluraUty of sen- 

data should be independent of the animation data. In the 55 tences, phrases, word segments or phonemes; 
preferred embodiment, animated character video, voice (b) digitally storing a preprogrammed branchmg dia- 
sound sequences and prompting word sequences are log between a first animated character and a sec- 

generated independently from separately stored digital ond ammated character, each branch comprismg a 

data. Dialog data that is not used in one scene may be pluraUty of alternative verbal expressions; 

used later in a different scene with the same or different 60 (c) generating a video signal representing an unage of 
characters. The voice data may consist of sequences of said first and second characters for display on a 

codes or compressed digital recordings of words, video screen; 

phrases, word segments or phonemes in several distinc- (d) displaying on a hand-held controDer apparatus a 
tive voices so that each character can speak thousands first set of alternatively selectable verbal expres- 

of preprogrammed words or sentences. Similarly, the 65 sions, each corresponding to a branch in said dia- 
digital data for each ammated character's body may be log; 

stored separately from sprite data for moving hps, facial (c) receiving from said hand-held controller a manu- 
exprcssions, and gestures, so that each character and its ally initiated signal representing a selected verbal 
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expression in said first set of verbal expresaons, 
thereby selecting a branch in the dialog; 

(f) digitally reading from said catalog of voices first 
voice sound data that corresponds to said selected 
verbal expression of the voice of said first charac- 5 
ten 

(g) generating an audio signal from said first voice 
sound data representing the voice of said first char- 
acter speaking said selected verbal expression; 

(h) digitally reading from said catalog of voices sec- 
end voice sound data for the voice of said second 
character speaking the verbal expression that fol- 
lows next in the selected branch of the dialog; 

(i) generating an audio signal from said second voice 
sound data representing the voice of said second 
character; and 

(j) displaying on said hand-held controller apparatus 
a second set of alternatively selectable verbal ex- 
pressions that follows next for said first character in 
the selected branch of the dialog. 

2. The method of claim 1, wherein one of said charac- 
ters is shown hugging or kissing the other character. 

3. The method of claim 1, wherem said hand-held 
controller is a portable game system with program car- ^ ^ 
tridge. 

4. A method of electronically simulating voice con- 
versations between at least two talking animated char- 
acters, the words of one character being selected by a 
human player, comprising the steps of: 3^ 

(a) digitally storing a catalog of distinctive voices for 
at least two talking characters, each in the form of 
voice sound data representing a plurality of sen- 
tences, phrases, word segments or phonemes; 

(b) digitally storing a preprogrammed branching dia- 35 
log between a first animated character and a sec- 
ond animated character, each branch comprising a 
plurality of alternative verbal expressions; 

(c) generating a video signal representing an image of 
said first and second characters for display on a 4^ 
video screen; 

(d) displaying on a hand-hdd controller apparatus a 
first set of alternatively selectable verbal expres- 
sions, each corresponding to a branch in said dia- 
log; 45 

(e) receiving from said hand-held controller a manu- 
ally initiated signal representing a selected verbal 
expression in said first set of verbal expressions, 
thereby selecting a branch in the dialog; 

(f) digitally reading fi-om said catalog of voices first 50 
voice sound data that corresponds to said selected 
verbal expression for the voice of said first charac- 
ter; 

(g) generating an audio signal fi-om said first voice 
sound data representing the voice of said first char- 55 
acter speaking said selected verbal expression; 

(h) changing said video signal to indicate that the first 
character is speaking to the second character; 

(i) digitally reading from said catalog of voices sec- 
ond voice so\md data for the voice of said second 60 
character speaking the verbal expression that fol- 
lows next in the selected branch of the dialog; 

(j) generating an audio signal from said second voice 
sound data representing the voice of said second 
character; 65 

(k) changing said video signal to indicate that the 
second character is speaking to the first character; 
and 



(1) displaying reading from said catalog of voices 
second voice sound data for the voice of said sec- 
ond character speaking the verbal expression that 
follows next in the selected branch of the dialog; 

0) generating an audio signal from said second voice 
sound data representing the voice of said second 
character; 

(k) changing said video signal to indicate that the 
second character is speaking to the first character; 
and 

0) displaying on said hand-held controller apparatus a 
second set of alternatively selectable verbal expres- 
sions that follow next for said first character in the 
selected branch of the dialog. 

5. The method of claim 4, wherein said video signal is 
changed to show moving lips on the face of the first 
character when said audio signal is generated from said 
first voice sound data; and wherein said video signal is 
changed to show moving lips on the face of the second 
character when said audio signal is generated from said 
second voice sound data. 

6. The method of claim 5, wherein said moving lips 
are lip-synchronized with the corresponding voices in 
said audio signal. 

7. The method of claim 4, fiirther comprising the step 
of altering either or both of said audio signals so that the 
signal indicates unspoken thoughts of an on-screen 
character. 

8. A method of electronically simulating voice con- 
versations between at least two on-screen talking ani- 
mated characters and an offscreen talking character, 
comprising the steps of: 

(a) digitally storing a catalog of distinctive voices for 
at least three talking characters, each in the form of 
voice sound data representing a plurality of sen- 
tences, phrases, word segments or phonemes; 

(b) digitally storing a preprogrammed branching dia- 
log between a first on-screen character and a sec- 
ond on-screen character and an off-screen charac- 
ter, each branch comprising a plurality of alterna- 
tive verbal expressions; 

(c) generating a video signal representing an image of 
said first and second on-screen characters for dis- 
play on a video screen; 

(d) displaying on a hand-held controller apparatus a 
first set of alternatively selectable verbal expres- 
sions, each corresponding to a branch in said dia- 
log; 

(e) receivbg fi'om said hand-held controller a manu- 
ally initiated signal representing a selected verbal 
expression in said first set of verbal expressions, 
thereby selecting a branch in the dialog; 

(f) digitally reading from said catalog of voices first 
voice sound data that corresponds to said selected 
verbal expression for the voice of said off-screen 
character; 

(g) generating an audio signal from said first voice 
soimd data representing the voice of said ofT-screen 
character speaking said selected verbal expression; 

(h) digitally reading from said catalog of voices sec- 
ond voice sound data for the voice of said first 
on-screen character speaking the verbal expression 
that follows next in the selected branch of the dia- 
log; 

Q) generating an audio signal from said second voice 
sound data representing the voice of said first on- 
screen character; 
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0 digitally reading from said catalog of voices third 
voice sound data for the voice of said second on- 
screen character spcaldng the verbal expression 
that follows next in the selected branch of the dia- 
log; 

(k) generating an audio signal from said third voice 
sound data representing the voice of said second 
on-screen character; and 

(I) displaying on said hand-held controller apparatus a 
second set of alternatively selectable verbal expres- 
sions that follows next for said off-screen character 
in the selected branch of the dialog. 

9. The method of claim 8, wherein said video signal is 
changed to indicate which of said on-screen characters 
is speaking. 

10. The method of claim 9, wherein said video signal 
is changed to show moving lips on the face of said first 
on-screen character when said audio signal is generated 
from said second voice sound data and to show moving 
lips on the iace of said second on-screen character when 
said audio signal is generated from said third voice 
sound data. 

11. The method of claim 10, wherein said moving lips 
are Up-synchronized with the corresponding voices in 
said audio signal. 

12. The method of claim 8, wherein said hand-held 
controller is a portable game system with program car- 
tridge. 

13. The method of claim 8, wherein said selected 
vertjal expression for said off-screen character is dis- 
played on said video screen. 

14. The method of claim 8, wherein one of said char- 
acteis is shown hugging or kissing the other character. 

15. A method of electronically simulating voice con- 35 
versations between at least two talking animated char- 
acters, the words of the characters being selected by 
two corresponding human players, comprising the steps 
of: 

(a) digitally storing a catalog of distinctive voices for 4Q 
at least two talking characters, each in the form of 
voice sound data representing a plurality of sen- 
tences, phrases, word segments or phonemes; 

(b) digitally storing a preprogrammed branching dia- 
log between a first animated character and a sec- 
ond animated character, each branch comprising a 
plurality of alternative verbal expression^ 

(c) generating a video signal representing an image of 
said first and second characters for display on a 
video screen; 

(d) displaying on a first hand-held controller appara- 
tus a first set of alternatively selectable verbal ex- 
pressions, each corresponding to a branch in said 
dialog; 

(e) receiving from said first hand-held controller a 55 
manually initiated signal representing a first se- 
lected verbal expression in said first set of verbal 
expressions, thereby selecting a branch in the dia- 
log; 

(f) digitally reading from said catalog of voices first 60 
voice sound data that corresi>onds to said first se- 
lected verbal expression for the voice of said first 
character, 

(g) generating an audio signal from said first voice 
sound data representing the voice of said first char- 65 
acter speaking said first selected verbal expression; 

(h) displaying on a second hand-held controller appa- 
ratus a second set of alternatively selectable verbal 
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expressions that follows next for said second char- 
acter in the selected branch of the dialog; 
(i) receiving from said second hand-held controller a 
manually initiated signal representing a second 
selected verbal expression in said second set of 
verbal expressions, thereby selecting a next branch 
in the dialog; 
(j) digitally reading fit)m said catalog of voices sec- 
ond voice sound data that corresponds to said sec- 
ond selected verbal expression for the voice of said 
second character; and 
(k) generating an audio signal from said second voice 
sound data representing the voice of said second 
character speaking said second selected verbal 
expression. 

16. A method of electronically simulating voice con- 
versations between at least two on-screen talking ani- 
mated characters and two ofT-screen talking characters, 
comprising the steps of: 

(a) digitally storing a catalog of distinctive voices for 
at least four talking characters, each in the form of 
voice sotmd data representing a plurality of sen- 
tences, phrases, word segments o phonemes; 

(b) digitally storing a preprogranuned branching dia- 
log between a first on-screen character and a sec- 
ond on-screen character and a first off-screen char- 
acter and a second off-screen character, each 
branch comprising a plurality of alternative verbal 
expressions; 

(c) generating a video signal representing an image of 
said first and second on-screen characters for dis- 
play on a video screen; 

(d) displaying on a first hand-held controller appara- 
tus a first set of alternatively selectable verbal ex- 
pressions, each corresponding to a branch in said 
dialog; 

(e) receiving from said first hand-held controller a 
manually initiated signal representing a first se- 
lected verbal expression in said first set of verbal 
expressions, thereby selecting a branch m the dia- 
log; 

(0 digitally reading from said catalog of voices first 
voice sound data that corresponds to said first se- 
lected verbal expression for the voice of said first 
off-screen character, 

(g) generating an audio signal from said first voice 
sound data representing the voice of said first off- 
screen character speaking said first selected verbal 
expression; 

(h) digitally reading from said catalog of voices sec- 
ond voice sound data for the voice of said first 
on-screen character speaking the verbal expression 
that follows next in the selected branch of the dia- 
log; 

(i) generating an audio signal from said second voice 
sound data representing the voice of said first on- 
screen character 

(j) displaying on a second hand-held controller appa- 
ratus a second set of alternatively selectable verbal 
expressions that follows next for said second off- 
screen character in the selected branch of the dia- 
log. 

(k) receiving from said second hand-held controller a 
manually initiated signal representing a second 
selected verbal expression in said second set of 
verbal expressions, thereby selecting a next branch 
in the disdog; 
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0) digitally reading from said catalog of voices third 
voice sound data that corresponds to said second 
selected verbal expression for the voice of said 
second off-screen character; ^ 

(m) generating an audio signal from said third voice 
sound data representing the voice of said second 
off-screen character speaking said second selected 
verbal expression; 



16 

(n) digitally reading from said catalog of voices 
fourth voice sound data for the voice of said sec- 
ond on-screen character speaking the verbal ex- 
pression that follows next in the selected branch of 
the dialog; and 

(o) generating an audio signal from said fourth voice 
sound data representing the voice of said second 
on-screen character. 

* * * 4 « 
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